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METHOD, COMPUTER PROGRAM PRODUCT AND APPARATUS FOR 
ENHANCING A COMPUTERIZED TOMOGRAPHY IMAGE 

Technical Field 

The present invention relates to a method, an 
apparatus and a computer program product for improving a 
5 digital image, and more specifically a computerized 
tomography image consisting of reconstructed data, 
according to the preamble of the respective independent 
claim. 

10 Technical Background 

It is known that in computerized tomography (CT) 
images, the intensity level may be used for 

distinguishing different types of tissue. A CT system may 
be calibrated such that the intensity values correspond 
15 to Hounsfield units (HU) as given in the table below: 



Tissue 


Intensity 
value [HU] 


Bone 


1000 


Liver 


40-60 


White matter in brain 


46 


Gray matter in brain 


43 


Blood 


40 


Muscle 


10-40 


Kidney 


30 


Cerebrospinal fluid 


15 


Water 


0 


Fat 


-50 - 100 


Air 


-1000 
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The Hounsfield units normally range from -1000 to 
3000, but in some applications the HU scale is shifted 
into values between 0 and 4000. 

As is apparent from the table above, examination of 
5 different types of tissue requires the inspection of 
different intensity value ranges, also referred to as 
intensity windows. 

Due to the limitations of display screens, and also 
to limitations of the human eye, it is common to display 
10 a maximum of 256 (2 8 ) different gray values or shades on 
the display screen. Hence, in order to obtain a useful 
view of a CT image showing tissues having intensity 
values close to each other, it is necessary to display 
only a limited portion of the total HU scale. 
15 In the following, the displayed or processed 

intensity value range will be referred to as an 
'intensity window'. If e.g. bones are examined one 
typically chooses a very wide window width of 1000-2000 
HU, whereas for the examination of soft tissue, more 
20 narrow window widths of 400-600 HU are used and for brain 
examinations very narrow window widths of 50-100 HU are 
common . 

Due to the different anatomies viewed and the very 
different intensity ranges, the different cases require 
25 different noise reduction and contrast enhancement 

treatment. However it is still desirable to store the 
result in one image and be able to switch between 
intensity windows in case different tissues are to be 
examined. 

30 In US 5,594,767, an original CT image is combined 

with a smoothed version of the original CT image, the 
combination being based on a classification map. The 
smoothed image is non-selectively smoothed, i.e. it 
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smoothes the entire image, regardless of the values of 
the respective image elements. 

Summary of the Invention 
5 It is an object of the present invention to provide 

an improved method for improving a CT image . 

The objective is wholly or partially achieved by a 
method and a computer program product according to the 
appended independent claims. Embodiments are set forth in 
10 the appended dependent claims and in the following 
description . 

Hence, there is provided a method for enhancing a CT 
image composed of a plurality of elements, each having an 
intensity value indicative of a tissue type. The method 

15 comprises receiving a first CT image, providing a 

plurality of copies of said first CT image, subjecting 
said plurality of copies of said first CT7 image to an 
enhancement processing, where said enhancement processing 
enhances said plurality of copies of saici first CT image 

20 with respect to predetermined intensity \ralue ranges, and 
combining said processed plurality of copies of said 
first CT image with said first CT image, whereby an 
enhanced CT image is provided, said combining being based 
on a classification with respect to interxsity values of 

25 regions within said first CT image and sa_id plurality of 
copies of said first CT image. 

A CT image may be any representation, of CT scan 
data, e.g. a two-, three- or four dimensional data set. 
The plurality of copies of the first CT image 

30 constitute enhancement processed full or partial copies 
of the first CT image, e.g. they may comprise subsets of 
the elements of the first CT image. 
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The enhancement processing may be any processing 
with a view to improving the quality of the plurality of 
copies of the first CT image. 

According to yet another aspect, there is provided a 
5 method for enhancing a first digital image composed of a 
plurality of elements , each having an intensity value 
associated therewith. The method comprises receiving a 
first digital image, providing, by enhancement processing 
based on said first digital image, a plurality of copies 

10 of said first digital image, and combining said plurality 
of copies of said first digital image with said first 
digital image, whereby an enhanced digital image is 
provided. The combining is based on a classification with 
respect to intensity values of regions within said first 

15 digital image and the plurality of copies of said first 
digital images. The enhancement processing is performed 
with respect to predetermined intensity value ranges. The 
digital image may be any type of medical image, such as a 
CT image, an x-ray image etc. The digital image may be 

20 two-, three-, or four dimensional. 

This approach allows for intrinsically different 
processing of different intensity windows. Also, the 
above described method enables the use of different 
processing settings for different intensity windows and 

25 then combines the results into one image. 

The presented approach also allows the use of more 
advanced processing methods that for instance adapt 
locally to the image structure in an anisotropic way. 
Hence, in contrast to prior art, the present 

30 invention keeps a weight for each considered intensity 
window, i.e. tissue class. Then different methods are 
applied to the different regions and finally the results 
are combined. A plurality of different images are created 
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that are combined into a single result according to the 
original intensity values. 

According to further aspects, there aire provided a 
computer program product and an apparatus for 
5 implementing the above described method. 



Brief description of the drawings 

Embodiments will now be described in more detail 
with reference to the appended drawings. 
10 Fig. 1 is a schematic flow chart illustrating a 

method according to the present disclosure. 

Fig. 2 is a schematic flow chart illustrating a 
detail of the flow chart of Fig. 1. 

Fig. 3 is a schematic diagram of a device 1 in which 
15 the method of Figs 1 and 2 may be implemented. 

Fig. 4 is a section of a simplified CT? image. 

Fig. 5 is a first processed version of the CT image 
in Fig. 4. 

Fig. 6 is a second processed version of the CT image 
20 in Fig. 4. 

Fig. 7 is a combined CT image based oq the first and 
second CT images. 

Figs 8-10 illustrates masks used in combining the CT 
images . 

25 

Description of Embodiments 

For a description of the general function of a CT 
system, reference is made to US 5, 594,767. Hence, the 
description of how a CT image is generated is left out. 
30 Fig. 1 flow chart illustrating a method for 

improving CT scan data, in step 101, a CT image is 
received. It is understood that a CT image, for the 
purpose of this description, may be received in different 
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manners and formats, e.g. from a storage device, via a 
computer network, or directly from a computer that 
performed an image reconstruction based on CT detector 
data . 

5 Furthermore, in the following description, the CT 

images are assumed to be two-dimensionally indexed data 
sets, composed of a plurality of elements, each of which 
being associated with an intensity value, which may be 
presented in Hounsfield units. Hence, the original CT 
10 image received in step 101 has been subjected to some 

known type of preprocessing and/or image reconstruction 
such as to provide a data set that is processable as an 
image . 

In step 102, processing parameters are received. 

15 Such processing parameters may include an indication of 
what intensity value range or ranges to study, an 
indication of what type or types of processing to 
perform, an indication of parameters subject to which the 
respective processing is to be performed. The input or 

20 inputs in step 102 may be received in different manners, 
e.g. in the form of a selection made by a user, in the 
form of an automatic determination made based on what is 
to be studied (e.g. what type of tissue), or it may be 
preprogrammed . 

25 It is recognized that steps 101 and 102 may be 

performed in the reverse order. 

In a first embodiment, the original CT image may be 
used as input to the processing step 103, whereby an 
enhanced image is provided as an output, and whereby the 
30 original CT image, or a copy thereof, is maintained. 

Optionally, one or more CT image copies may be 
provided based on the original CT image. The CT image 
copy may be used as input to the processing step 103, so 
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as to maintain the CT image intact. The CT image copies 
may be complete or partial copies of the original CT 
image. For example, a CT image copy may be a copy of only 
a region of the original CT image, such that the CT image 
5 copy becomes smaller than the original CT image. As 

another example, a CT image copy may be a copy of only 
those elements of the original CT image, which have 
intensity values within a certain, predetermined 
intensity value range. The CT image copies may be stored 

10 in a working memory or in a non-volatile memory. 

Step 102 and the step of providing the CT image copy 
may be performed in reverse order. 

In step 103, the original CT image and/or the CT 
image copies are subjected to enhancement processing, 

15 whereby an enhancement processed CT image is obtained. 
Each one of the images may be processed in a 
predetermined manner. In one embodiment, the different 
images are subjected to processing within certain 
intensity windows. In another embodiment, the different 

20 images are subjected to different types of processing, 

i.e. to different algorithms. In yet another embodiment, 
the different images are subjected to the same type of 
processing but with different processing parameters. In 
yet another embodiment, one of the images is not 

25 subjected to processing at all, whereas the other images 
are . 

In one embodiment, the CT image is maintained and 
then combined with the enhancement processed CT image. In 
yet another embodiment, also the original CT image is 
30 subjected to enhancement processing and then combined 

with another enhancement processed CT image. Hence, two, 
three or more enhancement processed CT images may be 
provided and combined. 
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There are many different types of processing of the 
original CT image and/or the CT image copies: low-pass 
filters, contrast enhancement using unsharp masking as 
described in US 5,038,387, rank filters such as the 
5 median and its variants and more advanced processing 

methods such as adaptive filtering, such as described in 
Westin, C. -F. , Richolt, J., Moharir, V. & Kikinis, R. : 
Affine Adaptive Filtering of CT Data , Medical Image 
Analysis 4, 161-177, 2000 and in US 6,556,720. Such 

10 adaptive filtering may for example be based on local 
structure analysis, as described in US 4,747,150, US 
4,747,151, US 4,747,152 and Carmona, R. A. & Zhong, S.: 
Adaptive smoothing respecting feature directions , IEEE 
Transactions on Image Processing 7(3), 353-358. 1998. 

15 Other types of processing includes mean-shift filtering 
as described in Dominguez, G.F., Bischof, H. & Beichel, 
R.: Fast 3D Mean Shift Filter for CT Images , SCIA, 438- 
445, 2003, Goteborg, Sweden, Springer, LNCS 2749; 
variational methods as described in Niessen, W. , Ter Haar 

20 Romeny, B. & Viergever, M.A. : Geodesic Deformable Models 
for Medical Image Analysis , IEEE Transaction on Medical 
Imaging 17(4), 634-641, 1998 and Gilboa, G., Sochen, N. & 
Zeevi, Y.Y.: Forward and Backward Diffusion Processes for 
Adaptive Image Enhancement and Denoising , IEEE 

25 Transaction on Image Processing 11(7), 689-703, 2002; 

multiband techniques such as those described in Dippel, 
S., Stahl, M., Wiemker, R. & Blaffert, T.: Multiscale 
Contrast Enhancement Radiographies : Laplacian Pyramid 
Versus Fast Wavelet Transform , IEEE Transactions on 

30 Medical Imaging 21(4), 343-353, 2002, Vuylsteke, P.P. & 
Schoeters, E.P.: Multiscale Image Contrast Amplification 
(MUSICA) , SPIE Vol. 2167 Medical Imaging: Image 
Processing, 551-560. 1994 and in US 5,644,662; or 
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wavelet techniques as described in Yang, G.Z., Rubens, 
M.B. & Hansell, D.M. : The use of hybrid structural 
filtering for the detection of obliterative bronchiolitis 
from computed tomographic images , IPA, IEE Conference 
5 Publication No. 443, 631-635, 1997. 

In one embodiment, it is determined beforehand which 
data subsets of the original CT image or CT image copy 
need to be processed, whereby all other data elements are 
excluded from the processing, in order to increase the 

10 overall execution speed. However, in a simple 

implementation the entire data set can be processed in 
parallel, or sequentially. 

There is no explicit need to segment the various 
intensity windows beforehand and it suffices to apply the 

15 various enhancement schemes adapted to each window in 
parallel. However, in order to speed up the overall 
calculation, it is possible to compute masks (weights) 
for each window as described below and only apply the 
computation where the associated weight differs from 

20 zero. 

In step 104, the enhancement processed images and 
possibly also the original CT image (or a copy thereof) 
are combined or merged such that a combined CT image is 
obtained. Merging of the results obtained by the 

25 different processing methods or parameter settings may be 
based on the associated intensity window or intensity 
value range. As changes are more visible for smaller 
window widths, the results may be ranked according to the 
window width, such that smaller windows are given 

30 priority over larger windows. 

In the following, a description of an algorithm for 
merging the images will be given with reference to Fig. 
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2, wherein the windows are assumed to be specified by 
their respective center c and width w. 

The algorithm may consist of the following steps, 
which are performed for all data elements: 
5 In step 1041, the CT images may be prioritized according 

to window width (intensity value range) , such that the 
window having the smallest width is placed first: wl < w2 
< ... < wN. By prioritizing the intensity windows, it is 
possible to control which window is to be used in case of 
10 overlapping areas. As an alternative, the prioritizing 

may be based on a user input, whereby the user determines 
which intensity window is to be used. 

In step 1042, region masks are determined by 
thresholding the original image, according to the 
15 following exemplifying pseudo code, wherein masks is the 
thus far segmented data, orglm is the original CT image, 
maskX is a mask for the respective CT image copy and 
maskB is a mask for the non-segmented parts of the 
original image. 
20 masks = 0 

for X = 1 ... N 
{ 

maskX - 1 if (cX - wX/2 < orglm ^ cX + wX/2) and (masks = 
0) 

25 masks = masks + maskX 

} 

maskB - non-segmented parts 

Step 1042 may also be expressed according to the 
30 following: 

1. initialize: M s (m,n) = 0 \/n,m 
x=l 
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[0 else 



3 . M s (m, ri) = M s (/??, ri) + M x (m, ri) 

4. if x < N then x = x+1 goto step 2 

5 

5 . M b (m 5 ri) = \M S (m, ri) - 1|| 

where Mi indicates mask number i and ±=x / s, b, I 
represents the original image data and m, n indexes the 
data elements. 

10 It is recognized that steps 1041 and 1042 may be 

performed in the reverse order. 

In step 1044, which is optional, the masks are smoothened 
by convolving with a low-pass kernel designated G: 
maskX = G * maskX for X = 1 ... N, B 

15 

Step 1044 may also be expressed according to the 
following: 

M X =G*M X 

which is to be understood as convolution of the entire 
20 mask array. 

In step 1045, the region masks are normalized according 
to the following exemplifying pseudo code: 

maskX = maskX / (maskl + mask2 + ... + maskN + maskB) for X = 1 

... N, B 

25 

Step 1045 may also be expressed as: 



M x (m,ri) = 



M l (m, ri) + M 2 (m, ri) + ... + M N (m, ri) + M B (m, ri) 
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In step 1046, the results are combined according to the 
following exemplifying pseudo code, wherein enhlm designates 
the enhanced combined CT image and where in resultX etc 
indicates the output of the processing s "tep 104a-c for CT 
5 image copy number X: 

enhlm = maskB • orglm + maskl • result H + ... + maskN • resultN 

Step 1046 may also be expressed as: 

1 0 E(m, ri) = M B (m 9 ri) • I(m, n) + M x (m, ri) • R x (m, n) + ...+ M N (m, ri) • R N (m, ri) 

where E denotes the final enhanced image and R±, i=l..N, 
the previously obtained results from the processing 
according to the individual intensity- windows. 
15 It should be noted that in ordeir to avoid artifacts 

near the boundaries of the respective regions, it is 
possible to apply a low-pass filter to the segmented 
masks in step 1044 above . In one embodiment, a small 
Binomial or Gaussian filter may be chosen, however any 
20 other low-pass kernel will do. 

The method segments the original data and then 
applies a spatial transition (smoothiLng) between areas to 
smooth the transition. 

The combining as described above , and in particular 
25 the normalizing, may be useful as the proposed method 

recombines intensity values and it is essential that the 
local mean of these Hounsfield units is not altered by 
the processing. 

In step 105, the combined CT image is output, e.g. 
30 by being displayed on a screen, stored in a memory or 
sent via a network. 

Optionally, a step 1047 comprisixLg a morphological 
closing and/or opening may be include d with respect to 
the masks, thereby removing or filling small gaps in the 
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respective masks. The morphological closing and/or 
opening step 1047 may be arranged to take place at 
anytime between the determination of the region masks 
1042 and the combining 104 6 of the CT images. 
5 Fig. 3 is a schematic diagram of a device 1 in which 

the above described method may be implemented. The device 
1 comprises receiving means 2 for receiving a CT image 
from e.g. a network, a storage medium or from a 
preprocessing device. The device 1 further comprises a 

10 processing unit 3, which is adapted for performing the 
above described method or methods. The device 1 also 
comprises output means 4 for outputting an enhanced CT 
image. The processing unit may consist of a programmable 
processor, which by means of software is programmed to 

15 perform the described method. In another embodiment, the 
preprocessing device may take the shape of a digital 
signal processor that is adapted to perform the described 
method. Such a preprocessing device may be provided in 
the form of e.g. an ASIC or any structure having similar 

20 functionality. 

It is also possible to implement the method in the 
form of a propagated signal comprising components for 
performing the steps of the above described method when 
said components are executed in a computer. 

25 Below, the processing of a section of a simplified 

2D CT image will be described with reference to Figs 4- 
10. In Figs 4-7, the horizontal axis illustrates image 
elements in e.g. a vertical line of the respective CT 
image. The vertical axis illustrates the HU value of the 

30 respective image element in the section. 

Fig. 4 is a section of an original CT image, e.g. as 
received in step 101 (Fig. 1) . In the described example, 
two intensity windows will be considered: a wide window 
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ranging from about 1250 HU to about 3 650 HU, which is 
illustrated by the dotted lines in Fig. 4; and a narrow 
window ranging from about 2150 to about 2600 HU, which is 
illustrated by the dashed lines in Fig. 4. The respective 
5 window may be determined as described above. In one 

particular embodiment, the limits of the intensity window 
may be determined by a graphical user interface, wherein 
the lines illustrating the limits of the intensity window 
are presented in relation to a section of the image that 

10 is to be processed, whereby the user, by means of a 

pointing device, drags the lines to desired positions. 

Fig. 5 is a first processed version of the original 
CT image in Fig. 4, as provided by step 103 (Fig. 1). In 
the illustrated embodiment, the original CT image of Fig. 

15 4 has been subjected to a low-pass filter, with respect 
to the wide window. Such low-pass filtering suppresses 
noise . 

Fig. 6 is a second processed version of the original 
CT image in Fig. 4. In the illustrated embodiment, the 

20 original CT image has been subjected to a structure- 
adaptive processing with respect to the narrow window. 
Such structure-adaptive processing preserves small 
details in the CT image, but does not suppress noise to 
the same extent. 

25 Fig. 7 is a combined CT image based on the first and 

second processed CT images, as provided by step 104 (Fig. 
1) . The combination has been made with respect to the 
intensity windows associated with the first and second 
processed CT images. 

30 Figs 8-10 illustrates masks used in combining the CT 

images. Fig. 8 illustrates the mask associated with the 
narrow window, i.e. with all image elements having values 
within that window. Fig. 9 illustrates the mask 
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associated with the wide window, i.e. with all image 
elements falling within that window, but outside the 
narrow window. Fig. 10 illustrates the background mask, 
i.e. with all image elements falling outside both the 
5 narrow and the wide window. It should be noted that the 
masks have a slightly smooth transition, due to the low- 
pass filtering of the original binary masks. 

It should also be noted that in case a morphological 
closing and/or opening step 1047 (Fig. 2) would be 
10 performed with respect to the masks illustrated in Figs 8 
and 9, then the unevenness shown in the regions between 
50-90 and 170-210 on the horizontal scale would be 
removed. 

Referring back to Fig. 7, it is noted that for those 

15 elements whose HU values fall outside both windows, the 
data from the original CT image (Fig. 4) is used. For 
those elements whose HU values fall within the narrow 
window, the data from the second CT image (Fig. 6) is 
used. For those elements whose HU values fall within the 

20 wide window, but outside the narrow window, the data from 
the first CT image (Fig. 5) is used. 

Even though the above description focuses on 2D 
image slices, the method is analogously applicable to the 
processing of higher dimensional data such as direct 3D 

25 or 4D enhancement of CT data. 

It should also be noted that although the 
description focuses on CT images, the described method is 
analogously applicable to any type of image, and in 
particular to medical images, such as x-ray, MRI, etc. 

30 Additional areas of application for the method 

described above include, but is not limited to, non- 
destructive testing, e.g. for use in quality assurance in 
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the manufacturing industry; analysis of logs in saw mills 
and in connection with airport luggage security checks. 
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